@compnerd I like the change to add a default type to get handle.

I think that we can make DefaultFloat == float all over the code. When I started working on this I assumed that we would need this flexibility, but now I see that everything is wired for the case where FloatTy = float. When we load numbers from caffe models they are assumed to be float. So, I suggest just getting rid of DefaultFloat and making it equal to float. ok?

Sounds reasonable enough to me. I can remove the use of the DefaultFloatTy. I wonder if we can de-templateize some of the declarations for a code-size win as well.

@compnerd Which declarations?

Some of the handle returning types were templated IIRC, but I didn't track them closely. I think we could do that as a follow up.